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BOUNDS FOR THE EXPECTED VALUE OF ONE-STEP 

PROCESSES 

BENJAMIN ARMBRUSTER, AdAM BESENYEI, AND PETER L. SIMON 


Abstract. Mean-field models are often used to approximate Markov 
processes with large state-spaces. One-step processes, also known as 
birth-death processes, are an important class of such processes and are 
processes with state space {0, 1,..., N} and where each transition is of 
size one. We derive explicit bounds on the expected value of such a 
process, bracketing it between the mean-field model and another simple 
ODE. While the mean-field model is a well known approximation, this 
lower bound is new, and unlike an asymptotic result, these bounds can 
be used for finite N. Our bounds require that the Markov transition 
rates are density dependent polynomials that satisfy a sign condition. 
We illustrate the tightness of our bounds on the SIS epidemic process 
and the voter model. 


1. Introduction 

Mean-field approximations of stochastic processes are crucial in many ar¬ 
eas of science, where a large system is described by a stochastic process and 
its expected behaviour is approximated by a simpler mean-field model using 
a system of differential equations. The stochastic processes of particular 
interest to us are binary network processes, where each node of a large net¬ 
work can be in one of two states and the state of a node changes depending 
on the states of the neighbouring nodes. The theory of their mathematical 
modelling can be found in several books and review papers [2, 4, 11, 12]. The 
two well-known examples we analyze in Section 4 are epidemic and rumour 
spreading. 

For concreteness we consider a continuous time Markov process, X{t), 
with states /c £ {0,1,... , N} and let Pk{t) = P[X{t) = k] denote the discrete 
probability distribution of X{t). The time evolution of Pk{t) is described by 
a linear system of differential equations, called the master equations. There 
is a well established theory for solving linear systems by expressing their 
solution as exp(At), where A is the transition rate matrix of the system. It 
is also well-known that the matrix exponential is hard to compute for large 
matrices, hence methods have been developed exploiting any special struc¬ 
ture of the matrix. Recently, an extremely powerful method has been worked 
out for tridiagonal matrices by Smith and Shahrezaei [15]. Since one-step 
processes have tridiagonal transition matrices, the time dependence of the 
probabilities Pk(t) can be computed very efficiently. Besides computational 
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methods there are theoretical approaches to approximate, estimate and char¬ 
acterize qualitatively the time dependence of the probability distribution 
and its moments (mainly its expected value). The typical approach is to in¬ 
troduce a low dimensional system of non-linear ODEs called the mean-field 
equations. These are not only faster to solve computationally but also allow 
for analysis giving a better qualitative understanding of the system. 

The accuracy of mean-field approximations is not obvious. The problem 
of rigorously linking exact stochastic models to mean-field approximations 
goes back to the early work of Kurtz [9] (see [6] for a more recent reference). 
He studied density-dependent Markov processes and proved their stochastic 
convergence to the deterministic mean-field model. It can be shown that the 
difference between the solution of the mean-field equation and the expected 
value of the process is of order 1/N as N tends to infinity [3]. 

However, it is natural to look for actual lower and upper bounds that can 
be used for finite N (in contrast to the previous asymptotic results). It is 
known that in many cases, the mean-field model yields an upper bound on 
the expected value of the process. The first lower bound is by Armbruster 
and Beck [1] where a system of two ODEs proves a lower bound on the ex¬ 
pected value in the case of a susceptible-infected-susceptible (SIS) epidemic 
model on a complete graph. The aim of this paper is to extend these re¬ 
sults to a wider class of Markov chains, including several which approximate 
network processes. 

We develop bounds for one-step processes, also known as birth-death pro¬ 
cesses, that form an important class of continuous time Markov processes, 
for which the state space is {0,1,... , A^} and it is assumed that transition 
from state k is possible only to states k — 1 aX rate and to state A -|- 1 at 
rate o^. The master equations are 

(I.I) p'k = Ok-iPk-i - {ak + Ck)pk + Cfc+ipfc+i, k = 0,...,N, 

where of course a_i = oat = cq = cat+i = 0. The bounds we develop are 
the solutions of simple ODEs and will hold for all N. We will illustrate with 
numerical examples that the upper and lower bounds are remarkably close 
to each other. 

In Section 2 we set up the problem, give the mean-field equation and 
the approximating system, state the main result, and state the tools used 
in the proof. Section 3 proves the main result. In Section 4 we illustrate 
the performance of the bounds on two examples: an SIS epidemic with and 
without airborne infection, and a voter-like model. Section 5 concludes and 
discusses directions for future research. 

2. Formulation of the main result 

2.1. Differential equations for the moments. We first establish the 
differential equations for the moments of the process X{t). We focus on the 
fraction X/N since we are interested in situations with large N and density 
dependent coefficients. By definition, the n-th moment of {X/N) is 

N 

yn{t) := E[iX{t)/N)^] = Y,{k/N)^pk{t) (n = 0,1,...). 

k=0 


( 2 . 1 ) 
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Of course uq = 1. The following equations for y'^ can be derived using 
Lemma 2 in [3], using the Kolmogorov backward equations, or taking the 
time derivative of (2.1) and substituting (1.1). 

1 ^ 

= + 1 )" - ^=’') +C?.{(k- 1 )" - 

k=0 

We are interested in the case when ak/N and Ck/N are polynomials of k/N. 
Then, y'^ can be expressed in terms of the coefficients of these polynomials. 
In fact, the following result was proved in [3]. 

Lemma 1. Let 

(2.2) ^ = A{k/N) and ^ = C{k/N) 

with polynomials A{x) = Ylj^o C'(x) = J2jLo such that 

^(1) = 0 and C(0) = 0. Then 

m 

(2.3) y[ = J2Djyj, 

j=0 

m ^ 

(2-4) y'^ = nJ2Djyn+j-i +j^Rn (n = 2,3,...) 

j=0 

where Dj = Aj — Cj, 0 < and c = + l^iD- 

2.2. Mean-field equation and an approximating system. Our mean- 
held equation 

m 

(2.5) y' = ^Djy^, y(0) = 7 / 1 ( 0 ), 

1=0 

is motivated by the approximations ^Rn ~ 0 and yn ~ ?/i for large iV, where 
the second approximation essentially assumes X/N is deterministic. We 
are interested whether the solution y of the mean-held equation converges 
uniformly on [0,T] to 7/1 as —)• 00. Recently in [I], the following special 
case was proved in an elementary way. 

Theorem 1. Let m = 2, Dq = 0, Di = r — 7 , and D 2 = — t with positive 
constants r and 7 . If y{0) = yi(0) = u G [0,1] is fixed, then for any fixed 
T > 0, 

yi{t)<y{t) fortG[0,T], 

and 

lim \y{t) — yi{t)\ =0 uniformly in t G [0, T]. 

V—>-oo 

In the theorem above, the constants r and 7 correspond to the infection 
and recovery rates in an SIS model of disease spread (see Subsection 4.1). 
Our aim is to generalize Theorem 1 to a broader class of coefficients Dj and 
to provide a lower bound for 7/1. In the proof of our main result we will not 
only compare y with 7/1 but also 7/"' with yn- Thus using (2.5), 

m m 

(y^y = ny^-^y' = n^Djy^^^-^ = ^ ( 7 /")^^^. 

1=0 1=0 
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Hence, the powers of y satisfy the initial value problem below: 

m 

( 2 - 6 ) y' = ^Djy^, 7/(0)=yi(0), 

j=0 

m 

(2.7) = y-(0) = y)^(O) (n = 2,3,...). 

j=0 

(The equation for y' is separated from {y'^)' for n > 2 because it will have 
a different role.) This system in combination with system (2.3)-(2.4) for y'^ 
motivates the following initial value problem: 

m 

(2.8) = '^DjZj, zi(0) = 2/i(0), 

j=0 

(2.9) z'^ = nJ2DjZn" 2n(0)=yi(0) (n = 2, ...,m), 

j=0 

where we let zq = 1- 

2.3. Main result. We are now ready to state our main result. 

Theorem 2 . Assume that 

(2.10) Dq > 0, Di ^ M. and Dj < 0 for j > 2, 

and let yi(0) = u € (0,1] be fixed. Then for the solutions y of (2.5) and zi 
of (2.8)-(2.9), it holds that 

zi{t) < yiit) < y{t) for t > 0 , 
zi{tT < yn{t) < Zn(t) fort>0, 2 <n<m, 
and for every T > 0 there exists a constant Ct > 0 such that 

zi{t) - y{t) in [0,T]. 

The proof is based on some familiar inequalities which we recall in the 
next subsection. 

2.4. Tools of the proof. The following comparison results are standard in 
the theory of ODEs, see [7]. 

Lemma 2 (Comparison). Suppose that f{t,x) is continuous in x; 

• the initial value problem x^it) = f{t,X 2 {t)), X 2 ( 0 ) = xq has a unique 
solution for t G [0, T]; 

• x'i{t) < f{t, xi{t)) for t G [0, T]; and xi(0) < xq. 

Then xi{t) < X 2 {t) for t G [0, T]. 

Lemma 3 (Peano’s inequality). Suppose that fi,f 2 - [0,7"] x [a,b] —>■ M 
are Lipschitz continuous functions in their second variable with Lipschitz 
constant L and \fi{t,x) — f 2 {t,x)\ < M in [0,T] x [a,b] with some constant 
M. If 

• x[{t) = fi{t,xi{t)),x' 2 it) = f 2 {t,X 2 {t)) for t G {0,T] and 

• 3:1(0) = 3:2(0), 
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then 

\xi{t) - X 2 it)\ < ^ - 1) {t€ [0,r]). 

The classical Jensen’s inequality and the definition of the expected value 
yields the probabilistic version of Jensen’s inequality, see [13]. 

Lemma 4 (Jensen’s inequality). If X is a random variable and (/?: M —)• M 
is a convex function, then 

^iE[X]) <E[ip{X)]. 

For concave (/?, the reverse inequality holds. 

3. Proof of the main result 

Proof of Theorem 2. The proof will be carried out in multiple steps. First, 
we derive bounds for and Zn independent of N which will guarantee uni¬ 
form Lipschitz constants with respect to N in steps three and four. Second, 
we show that y\ < y. In the third step, we show that yn < Zn for n >2 and 
use Peano’s inequality to deduce from equations (2.7), (2.4) and (2.9) that 
there is some constant C{n, T) depending on n and T such that 

|y”(t) - Zn{t)\ < for te[0,T], n = 2,...,m. 

Finally with these estimates at hand, we obtain in the same manner zi < yi 
and 

| 2 /(t) - 2 :i(t)| < ^ for t e [0,r], 
with some suitable constant Ct- 

Step 1: A priori bounds independent of N. We first focus on a 
lower bound for The definition of yn implies 0 < ye < yn for all n < £. 
Therefore, 

m 

y'l > F»o + yi ^ Dj > yiD, yi(0) = n, 
j=i 

where the second inequality is due to (2.10) and we define D = 

Applying Lemma 2 we obtain 

2/1 (t) > ue*^. 

Now due to Jensen’s inequality, 

(3.1) 2/" = E[A/iV]^ < E[{X/Nr] = yn for n > 1. 

Defining 6i{T) = n™min{l,> 0, this leads to our lower bound, 

(3.2) Unit) > yi{t) > > Ji(r) for 1 < n < m,t G [0,T]. 

Next we focus on an upper bound for Zn for n > 2. We bound the 
definition (2.9) by assuming Zn > 1. Then using the sign condition (2.10), 

71 — 1 

Zn'^ < Zn, and A > 1, 

z'n < n{DQ + [Dij -|- cn)zn, Zn{£f) = n” for n > 2. 

Applying Lemma 2 to this differential inequality, we obtain an upper bound, 

(3.3) Zn{t) < < 62 {T) for 2 < n < m,t G [0,r], 
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where 52 {T) = max{l, 

Step 2: Comparison of y and yi. Substituting (3.1) into (2.3) with 
regard to the sign condition (2.10) yields 

m 

3=0 

Applying Lemma 2 to the above inequality and to (2.5) yields for t G [0, T], 

(3.4) yi{t) < y{t). 

Step 3: Comparison of y'^, and Zn- Applying Jensen’s inequality 
again, 

. n+7-l ra+.7 -1 

(3.5) yn+ 3 -i = K[{X/Nr+^-^] > E[(X/Ar)"]— = " for j > 1, 

1 n-l ^-1 

(3.6) yn-i = E[(X/iV)"-i] < E[(X/iV)-]— = . 

We also have the trivial estimate 

(3.7) 0 < < 1. 

Putting the estimates (3.5), (3.6) and (3.7) into the differential equation 
(2.4) of the n-th moment for n > 2 and taking care of the sign condition 

(2.10) we obtain 

(3.8) y'„<nY,D,y— + !/„{0) = s?(0) = »" 

3=0 

By introducing the function gn{x) = nY^J^=QDjX ^ (3.8) can 

be written as y!^ < gniVn), and (2.9) has the form z'^ = gnizn)- Now, g-nix) 
is Lipschitz continuous except at 0. Thus we can apply Lemma 2 while 
Zn > ^i{T) holds, to obtain 

(3.9) Unit) < Zn{t) for 2 < n < m,t G [0,T]. 

Fortunately, (3.2) ensures Znit) > yn{t) > ^i{T) for t < T and 2 < n < m. 
Using the same steps and (2.7) we can also show that 

(3.10) y^{t) < Zn{t) for 2 < n < m,t G [0,T]. 

Now, 

(3.11) 52 {T) > Zn{t) > y"'{t) > yi{t) > 6i{T) for 2 < n < m,t G [0,r], 

where the inequalities are from (3.3), (3.10), (3.4), and (3.2), respectively. 

This lets us use Peano’s inequality to estimate the difference of the solu¬ 
tion y" of (2.7) and Zn of (2.9) since 4 = 9 n{zn), (4)' = ffn(y") - 
and (3.11) ensures a Lipschitz constant independent of N. Therefore, there 
is some constant C{n, T) depending on n and T such that 

(3.12) |y”(t) - Zn{t)\ < for 2 < n < m,t G [0,T]. 

Step 4: Comparison of yi and zi. Now, with estimates (3.9) and 

(3.12) in our hand we turn to equations (2.6), (2.3), (2.8) to obtain estimates 
on their solutions analogously to the preceding part of the proof. First, by 
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substitution of estimates (3.9) into (2.3) with regard to the sign condition 
(2.10) it follows that 

m 

(3.13) y[> Dq +Diyi + ^DjZj, ?/(0) = yi(0) = u. 

i=2 

Considering functions Zn {n = fixed, then (3.13) and (2.8) have 

the form y[{t) > gi{t,yi{t)) and z[{t) = gi{t,zi{t)) where gi{t,x) = Dq + 
Dix + Thus, Lemma 2 implies 

yi > 


and this leads to the lower bound for the n-th moment as yn > Zi by using 
(3.2). 

Now we apply Peano’s inequality to estimate the difference of the solution 
y of (2.6) and zi of (2.8). Indeed, y'{t) = hi{t,y{t)) and z[{t) = gi(t,zi{t)) 
where hi{t, x) = Dq + Dix + ^^=2 Therefore, 

m 

hi{t,x) - gi{t,x) = ^Dj{y\t) - Zj{t)). 
i=2 


Thus by (3.12), 

i, f. s u w ^ m ■ max 2 <n<m\Dn\C{n,T) , ^ m t-i 
\hi{t,x) -gi{t,x)\ < -—- for t G [0,r]. 

Then Peano’s inequality implies that there is some constant C depending 
on m and T such that 

C 


\y{t) -zi{t)\< — for t G [0,r]. 


The proof is now complete. 


□ 


4. Examples 

Here we show numerically the lower and upper bounds in the case of two 
network processes. 

4.1. SIS epidemic propagation with and without airborne infec¬ 
tion. Consider SIS epidemic propagation on a regular random graph with 
N nodes. We allow for multiple routes of infection so that the infection 
spreads not only via the contact network, but also due to external forcing, 
such as airborne infection. The state space of the corresponding one-step 
process is {0,1 ,... , A^}, where k denotes the state with k infected nodes. 
In fact, the position of the infected nodes also affects the spreading pro¬ 
cess, hence the state space is larger, and therefore our model is only an 
approximation of the real infection propagation process. The validity of this 
approximation is discussed in detail in [10]. We note that in the case of a 
complete graph, the model is exact. Starting from state k the system can 
move either to state A: -|- 1 or to A: — 1, since at a given instant only one 
node can change its state. When the system moves from state A; to A; -|- 1 
then a susceptible node becomes infected. The rate of external infection of 
a susceptible node is denoted by /3. The rate of internal infection is propor¬ 
tional to the number of infected neighbours, which is in average, where 



B. ARMBRUSTER, A. BESENYEI, AND P. L. SIMON 


d denotes the degree of each node in the network and ^ is the proportion 
of the infected nodes. Since there are N — k susceptible nodes and each of 
them has infected neighbours the total number of SI edges is d{N-k)-^. 
Then the rate of transition from state k to state /c + 1 is obtained by adding 
the rates of the two infection processes 

ak = Td{N -k)^+ I3{N - k). 

where r is the infection rate. The rate of transition from state k io k — 1 
is Ck = 7 /c, because any of the k infected nodes can recover with recovery 
rate 7. Using these coefficients, ak and Ck, the spreading process can be 
described by equation (1.1). The coefficients can be given in the form (2.2) 
by choosing the functions A{x) = Tdx{l — x) + /3(1 — x) and C{x) = jx. 
The coefficients of these polynomials are Aq = j3, Ai = rd — /3, A2 = —rd, 
Co = 0, Cl = 7 and C 2 = 0. Thus the coefficients 

Do = /3, Hi = rd - /3 - 7 , D2 = -rd 

satisfy the sign condition (2.10). According to (2.5), the mean-field equation 
takes the form 

(4.1) y' = (I + {rd - P - -f)y - rdy"^ 

subject to the initial condition y( 0 ) = i/N, where i is the number of initially 
infected nodes. System (2.8)-(2.9) can be written as 

(4.2) z'i= jd + [rd - 13 - 7)21 - rdz 2 , 

(4.3) Z2 = 2/3^2^^ + 2(Td - f3 - 7 ) 2:2 - 

where c = /3+|rd—/ 3 |+rd-|- 7 . The initial condition is 2:1 = i/A", 2:2 = (i/A)^. 
The mean-field equation (4.1) and the system (4.2)-(4.3) can be easily solved 
with an ODE solver. 

The solutions without airborne infection, /3 = 0, are shown in Figure 1 
for A = 10® and A = 10^. It is important to note that for such large values 
of A the master equation (1.1) cannot be solved numerically, but we know 
that the expected value yi{t) = '^k=o^Pk{t) is between the two curves 
given in the Figure. We can also see that for small times the two bounds 
are nearly identical, i.e., we get the expected value with high accuracy. As 
time increases the bounds move apart, moreover the length of time interval, 
where the two bounds give the expected value accurately increases with A. 

The solutions with airborne infection, /3 > 0, are shown in Figure 2 for 
A = 100 together with the expected value yi{t) = Ylk=o obtained 

by solving the master equation (1.1) for One can see that the expected 
value is between the two bounds, in fact, it is hardly to distinguish from 
the solution of the mean-field equation, therefore the stationary part of the 
curves are enlarged in the inset. Note that the performance of the bounds is 
much better than in the case without airborne infection. Here we get much 
closer bounds even for a small value of A. 

4.2. A voter-like model. Consider again a regular random network where 
each node can be in one of two states, 0 or 1 , representing two opinions 
propagating along the edges of the network (see [ 8 ]). If a node is in state 
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0 and has j neighbours in state 1 , then its state will change to 1 with 
probability jrAt in a small time interval At. This describes a node switching 
to opinion 1. The opposite case can also happen, that is a node in state 1 
can become a node with opinion 0 with a probability j'jAt in a small time 
interval At, if it has j neighbours in state 0. The parameters r and 7 
characterize the strengths of the two opinions. Voter models are related 
to the famous Ising spin model in physics where the atomic spin, ± 1 , in 
a domain is affected by the spin in neighboring domains. The state space 
of the corresponding one-step process is { 0 , 1 ,..., A}, where k denotes the 
state, in which there are k nodes with opinion 1. Starting from state k the 
system can move either to state A: + 1 or to A; — 1, since at a given instant 
only one node can change its opinion. When the system moves from state 
A; to A: + 1 then a node with opinion 0 is “invaded” and becomes a node 
with opinion 1. The rate of this transition is proportional to the number of 
neighbours with opinion 1 , which is d-^ in average, where d is the degree of 
each node in the network and ^ is the proportion of the nodes with opinion 
1. Since there are N — k nodes with opinion 0 and each of them has d^ 
neighbours with the opposite opinion the total number of edges connecting 
nodes with two different opinions is d{N — k)^. Hence the rate of transition 
from state k to state A: + 1 is 


Qk = Td{N - k) — . 

Similar reasoning leads to the rate of transition from state A: to A; — 1 as 


Cfc = 'jdk 


N -k 
N 


Using these coefficients, ak and Ck, the spreading process can be described 
by equation (1.1). The coefficients can be given in the form (2.2) by choosing 
the functions A{x) = Tdx{l — x) and C{x) = ')dx{l — x). The coefficients 
of these polynomials are Aq = 0 , Hi = rd, A 2 = —rd, Cq = 0, Ci = yd and 
C 2 = —yd. Thus the coefficients 


Dq = 0, Di = rd — 'jd, T >2 = yd — rd 

satisfy the sign condition (2.10) if y < r. According to (2.5) the mean-field 
equation takes the form 

(4.4) y'= (rd-yd)(y-y^) 

subject to the initial condition y(0) = i/N, where i is the number of nodes 
with opinion 1 at time 0. System (2.8)-(2.9) can be written as 

(4.5) — ijd — yd)zi — {rd — 'jd)z 2 , 

(4.6) 4 = 2(rd - yd)z2 - 2(rd - 'yd)zl^‘^ + 

where c = 2rd -|- 2yd. The initial condition is zi = i/N, Z 2 = (i/N)'^. The 
mean-field equation (4.4) and system (4.5)-(4.6) can be easily solved with 
an ODE solver. The solutions are shown in Figure 3 both for D 2 < 0 (left 
panel) and for D 2 > 0 (right panel). For D 2 < 0 the lower bound performs 
well only for large values of N. The master equation (1.1) cannot be solved 
numerically for such large values of N. Hence the expected value yi is not 
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shown in the left panel. For D 2 > 0, i.e., when 7 > r, the role of y and 
zi is exchanged. The solution y of the mean-field equation becomes the 
lower bound and zi becomes the upper bound. The function y is hardly 
distinguishable from the expected value yi, the inset shows that y is really 
a lower bound. 



Figure 1. SIS epidemic without airborne infection. The 
solution y of the mean-field equation (4.1) (continuous curve) 
and the first coordinate zi of the solution of system (4.2)- 
(4.3) for N = 10® (dashed curve) and for N = 10^ (dashed- 
dotted curve). The parameter values are 7 = 1, r = 0.1, 
d = 30, and /3 = 0. 



Figure 2. SIS epidemic with airborne infection. The solu¬ 
tion y of the mean-field equation (4.1) (continuous curve), 
the first coordinate zi of the solution of system (4.2)-(4.3) 
(dashed curve) and the expected value yi obtained from the 
solution of the master equation (dashed-dotted curve). The 
stationary part of the curves are enlarged in the inset. The 
parameter values are N = 100, 7 = 1, r = 0.05, d = 20 and 
/3 = 1. 
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time 



time 


Figure 3. Voter-like model. The solution y of the mean- 
held equation (4.4) (continuous curve), the hrst coordinate 
zi of the solution of system (4.5)-(4.6) (dashed curve) and the 
expected value yi obtained from the solution of the master 
equation (dashed-dotted curve). Left panel: the case D 2 < 0, 
the values of N are shown in the hgure, the other parameter 
values are 7 = 0.1, r = 0.2, d = 10. Right panel: the case 
D 2 > 0, the parameter values are N = 200, 7 = 0.2, r = 0.1, 
d = 10. The stationary part of the curves are enlarged in the 
inset. 



Figure 4. Potential lower bounds of SIS model without air¬ 
borne infection. The solution y of the mean-held equation 
(4.1) (continuous curve), the hrst coordinate zi of the solu¬ 
tion of system (5.1)-(5.2) (dashed curve) for different values 
of q shown in the hgure, zi of the solution of system (5.3)- 
(5.4) (dotted curve) and the expected value yi obtained from 
the solution of the master equation (dashed-dotted curve). 
The parameter values are N = 100, 7 = 1, r = 0.1, d = 30, 
and /3 = 0 . 


5. Disgussion 

We started from the master equation of a one-step process, assumed that 
the coefficients are density dependent, and the functions A and C are poly¬ 
nomials. Then under certain sign condition on the coefficients of the poly¬ 
nomials we proved that the mean-held equation yields an upper bound for 
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the expected value of the process. We constructed an auxiliary system for 
the artificially defined functions Zj, and proved that zi is a lower bound. 
We showed several examples, where the upper and lower bounds are close to 
each other, hence the method can be used to approximate the expected value 
without solving the large system of master equations or using simulation, 
which only gives probabilistic guarantees. 

Two avenues for future research are relaxing the sign condition (2.10) and 
improving the lower bound. It is easy to see that in the case Dj > 0 for 
j > 2 and following the argument in Step 2 that the mean field eqnation 
yields a lower bound. Also in the voter-like model, a violation of the sign 
condition (i.e., when 7 , the rate of switching to opinion 0 , is greater than 
r, the rate of switching to opinion 1 ) can be dealt with by switching the 
labels of the opinions or equivalently replacing x hy 1 — x. Perhaps more 
general violations of the sign condition can be dealt with by considering the 
convexity or concavity of the entire polynomials A[x) and C{x) instead of 
by the signs of their coefficients. 

The second avenue for future research is improving the lower bonnd. Un¬ 
like the case of SIS disease propagation with airborne infection, /3 > 0, where 
the upper and lower bonnds are very close to each other even for small sys¬ 
tem sizes, say N = 100, we can see that for the case of regnlar SIS epidemic 
withont airborne infection, /3 = 0 , and the voter-like model, that the lower 
bound may be quite far from the expected value for moderately large N, 
say N = 10^. 

The reason that the lower bound veers off to 0 is that 22 converges to a 
positive steady state and then the derivative of zi becomes negative after 
some time. This problem can be overcome by altering the differential eqna¬ 
tion of zi- The term D2Z2 could be changed to a term that contains also 
zi in order to prevent zi from becoming negative. The new term could be 
introduced by exploiting the fact that Zj approximates the j-th moment yj 
and this function can be approximated by yK This suggests that Z2 can be 
approximated by z^, or in other words, zi approximates In order to 

tune the approximation we introduce the artificial parameter q S [ 0 , 2 ] and 
change the term D2Z2 to D2Z^‘^ . For g = 0 we obtain the mean-field 
upper bound and for g = 2 we get back the original lower bound. In the 
qnadratic case the modified differential eqnations for the lower bound of the 
SIS epidemic (4.2)~(4.3) without airborne infection, /3 = 0, are 

(5.1) + DyZx + D2zl/‘^zl-’^ 

(5.2) z '2 = 2DQzy‘^ + 2DiZ2 + 2D2zl^^ + 

In Figure 4 the solution of this system is shown for different values of g 
together with the solution of the mean-field equation and the expected value. 
The curve for g = 0.5 is close to the mean-field upper bound (i.e., g = 0) 
and at least appears to be a valid lower bound for yi. 

An alternate approach for an improved lower bound modifies the differ¬ 
ential equation for Z2 (2.9) by replacing the z^^ term by z\lz\ resulting in 
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the system 

(5.3) z[ = Dq + Dizi + D 2 Z 2 

(5.4) Z 2 = ‘IDqz^ + 2 D 1 Z 2 + 2 D 2 Z 2 /Z 1 + —. 

By Jensen’s inequality, ^ Vs- Thus assuming Z 2 ~ y 2 , the term 
can be interpreted as a lower bound for a 1/3 term. Now we motivate the 
Z 2 /Z 1 term. Using the Cauchy-Schwarz inequality, < 2/31/1, leads to a 
lower bound y \ ly \ < 1/3 that appears to be tighter than 1/2^^ • Assuming 

z\ « yi and Z 2 ~ 1/2 then motivates using z^/zi instead of z^^. From 

Figure 4 it appears to be a valid lower bound for yi and closer to the mean- 
field upper bound than the original lower bound. Of course these potential 
lower bounds (5.1)-(5.2) and (5.3)-(5.4) are only justified by a numerical 
experiment (Figure 4) and some intuition. It is an open question whether 
these are provable lower bounds or not. 
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